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DETAILED ACTION 

1 . This Office Action is in response to correspondence filed October 26, 201 0 in 
reference to application 10/733,995. Claims 1-16 are pending and have been 
examined.. 

Continued Examination Under 37 CFR 1. 1 14 

2. A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1 .1 7(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on October 
4, 2010 has been entered. 

Response to Amendment 

3. The amendment filed October 4, 201 0 has been accepted and considered in this 
office action. Claims 1, 7, and 13 have been amended. 

Response to Arguments 

4. Applicant's arguments filed October 4, 21 01 0 have been fully considered but they 
are not persuasive. Regarding applicant's arguments, see Remarks pages 7-8 that 
Yuschik and Mahajan do not teach the limitations of a "measure of how distinguishable 



Application/Control Number: 10/733,995 Page 3 

Art Unit: 2626 

the current grammar is from the at least one grammar from the second menu of the 
voice portal," after further consideration of the references, the examiner respectfully 
disagrees. Upon review of Yuschik, examiner notes that Yuschik teaches that the same 
words may appear on several sub menus (see Col. 13 line 48-50). Thus when Yuschik 
compares grammars of the same menus to check for acoustic confusability, Yuschik is 
comparing words across menus as well, when a word appears on the menu being 
examined and another menu as well. Thus Yuschik teaches the limitations in question. 

Claim Rejections - 35 USC §112 

5. The following is a quotation of the first paragraph of 35 U.S.C. 1 1 2: 

The specification shall contain a written description of the invention, and of the manner and process of 
making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the 
art to which it pertains, or with which it is most nearly connected, to make and use the same and shall 
set forth the best mode contemplated by the inventor of carrying out his invention. 

6. Claims 7-1 2 are rejected under 35 U.S.C. 1 1 2, first paragraph, as failing to 
comply with the written description requirement. The claim(s) contains subject matter 
which was not described in the specification in such a way as to reasonably convey to 
one skilled in the relevant art that the inventor(s), at the time the application was filed, 
had possession of the claimed invention. The limitations "computer readable storage 
medium" does not appear in the original specification. Only "machine readable storage" 
appears in the original claims. The scope of "machine readable storage" and "computer 
readable media" are different. Furthermore the original specification does refer to 
"storage media" at paragraph 0021 , but only applied to storage of signals, not 
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instructions. Thus the language in the claims has not support in the original 
specification. 

Claim Rejections - 35 USC § 101 

7. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

8. Claims 7-1 2 are rejected under 35 U.S.C. 1 01 because the claimed invention is 
directed to non-statutory subject matter. 

9. Claims 7-12 are directed to a computer readable medium storing processor 
executable instructions that is not limited to a tangible, and thus, statutory medium. The 
United States Patent and Trademark Office (USPTO) is obliged to give claims their 
broadest reasonable interpretation consistent with the specification during proceedings 
before the USPTO. See In re Zletz, 893 F.2d 319(Fed. Cir. 1989) (during patent 
examination the pending claims must be interpreted as broadly as their terms 
reasonably allow). The broadest reasonable interpretation of a claim drawn to a 
computer readable medium (also called machine readable medium and other such 
variations) typically covers forms of non-transitory tangible media and transitory 
propagating signals per se in view of the ordinary and customary meaning of computer 
readable media, particularly when the specification is silent. See MPEP 21 1 1 .01 . When 
the broadest reasonable interpretation of a claim covers a signal per se, the claim must 
be rejected under 35 U.S.C. 101 as covering non-statutory subject matter. See In re 
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Nuijten, 500 F.3d 1346, 1356-57 (Fed. Cir. 2007) (transitory embodiments are not 
directed to statutory subject matter) and Interim Examination Instructions for Evaluating 
Subject Matter Eligibility Under 35 U.S.C.j101 , Aug. 24,2009; p. 2." In the present case, 
the computer readable medium is only generally/broadly recited in the 
specification/original claims (original claims 7-12. specification paragraph 0021, "storage 
media" but only applied to storage of signals, not instructions). Thus the scope of 
"computer-readable medium" broadly includes signal-based mediums. A signal does 
not fall within one of the four statutory categories of invention (i.e., process, machine, 
manufacture, or composition of matter) because it is an ephemeral, transient signal and 
thus is non-statutory. Since the scope of "computer-readable medium" includes these 
non-statutory instances, claims 7-12 are directed to non-statutory subject matter. 

1 0. Examiner suggests the language "non-transitory machine readable storage" to 
obviate the 1 1 2 and 1 01 rejections of claims 7-1 2. 

Claim Rejections - 35 USC § 103 

1 1 . The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

1 2. Claims 1,3,4, 7, 9, and 1 0 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Yuschik (US Patent 7,139,706) in view of Mahajan et al. (US Patent 
7,117,153). 
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1 3. Consider claim 1 , Yuschik teaches a method of evaluating grammars associated 
with a voice portal on a portal server (Fig 3), said method comprising: 

receiving at least one measure of how distinguishable the current grammar is 
from other grammars of a set of active grammars that are active when the current 
grammar is active, the set of active grammars including the current grammar and at 
least one grammar from a second menu of the voice portal, the at least one measure 
based at least in part on analysis of the test pattern with respect to the set of active 
grammars (steps 340-360, acoustic analysis is performed to compare between different 
sub-vocabularies or menu options [active vocabularies in the instant application] to 
determine acoustic similarities. Column 12 lines 25-64), the at least one measure 
comprising at least least one measure of how distinguishable the current grammar is 
from the at least one grammar from the second menu of the voice portal (The same 
words may appear on several sub menus; Col. 13 line 48-50. Thus when Yuschik 
compares grammars of the same menus to check for acoustic confusability, Yuschik is 
comparing words across menus as well, when a word appears on the menu being 
examined and another menu as well.); and 

determining whether to modify the current grammar based at least in part on the 
at least one measure (system may choose to substitute alternative words; column 12 
line 50). 

Yuschik does not specifically teach: 
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generating for a current grammar of the voice portal representing a valid input for 
a first menu of the voice portal, a test input, the test input for the current grammar 
including a test pattern; 

providing the test input to the voice portal on the portal server using a voice 

server. 

In the same field of predicting word errors, Mahajan teaches generating for a 
current grammar of the system put, the test input for the current grammar including a 
test pattern (At step 202, a portion of training data 304 is spoken by a person 308 to 
generate a test signal, in order to test the recognition models; Column 5 line 11.); 

providing the test input to the voice system on the portal server using a voice 
server (The acoustic signal is converted into waveforms by receiver 309 and feature 
extractor 310, and the feature vectors are provided to a decoder 312; column 5 lines 13- 
15.). 

Therefore it would have been obvious to one of ordinary skill in the art to 
substitute actual acoustical data as taught by Mahajan for the phonetic representations 
in Yuschik in order to facilitate a more accurate measure of confusion between sub- 
vocabularies. 

1 4. Consider claim 3, Yuschik teaches modifying the current grammar to create a 
grammar if the at least one measure indicates that the current grammar is not 
sufficiently distinguishable (figure 3, step 340 does an acoustic analysis to determine 
similarity in order to reduce recognition error, step 350 selects alternative words if 
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necessary, thereby providing a less confusable alternative to the words available to be 
recognized; column 1 1 line 34- column 13 line 3). 

1 5. Consider claim 4, Yuschik teaches the method of claim 3, further comprising the 
steps of: 

iii) receiving at least one measure how distinguishable the modified grammar is 
from other grammars of the set of active grammars that are active when the modified 
grammar is active, the current grammar being one grammar of the set of active 
grammars (steps 340-360, acoustic analysis is performed to compare between different 
sub-vocabularies or menu options [active vocabularies in the instant application] to 
determine acoustic similarities. Column 12 lines 25-64). ; and 

(iv) modifying the modified grammar and repeating steps (i) through (iii) until the 
measure of how distinguishable the modified grammar is from other grammars of the 
set of active grammars that are active when the modified grammar indicates that the 
modified grammar is sufficiently distinguishable from the other grammars of the set of 
active grammars that are active when the modified grammar is active. (This is merely 
reanalyzing the output of the recognizer after the grammar has been updated. Figure 3 
of Yuschik shows that the acoustical analysis of 340 is repeated until the acoustical 
difference is great enough to allow for accurate speech recognition.). 

Yuschik does not specifically teach: 

(i) generating a test input for the modified grammar, the test input including a test 
pattern for the grammar (Mahajan At step 202, a portion of training data 304 is spoken 
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by a person 308 to generate a test signal, in order to test the recognition models; 
Column 5 line 11.); 

(ii) providing the test input for the modified grammar to the voice portal () 
(Mahajan, the acoustic signal is converted into waveforms by receiver 309 and feature 
extractor 310, and the feature vectors are provided to a decoder 312; column 5 lines 13- 
15.); 

In the same filed of predicting word errors, Mahajan teaches: 

(i) generating a test input for the modified grammar, the test input including a test 
pattern for the grammar (Mahajan At step 202, a portion of training data 304 is spoken 
by a person 308 to generate a test signal, in order to test the recognition models; 
Column 5 line 1 1 .); 

(ii) providing the test input for the modified grammar to the voice portal () 
(Mahajan, the acoustic signal is converted into waveforms by receiver 309 and feature 
extractor 310, and the feature vectors are provided to a decoder 312; column 5 lines 13- 

15. ); 

Therefore it would have been obvious to one of ordinary skill in the art to 
substitute actual acoustical data as taught by Mahajan for the phonetic representations 
in Yuschik in order to facilitate a more accurate measure of confusion between sub- 
vocabularies. 

1 6. Consider claim 7, Yuschik teaches A Computer readable storage medium 
encoded with instructions which, when executed by a computer, cause the computer to 
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perform a method of evaluating grammars associated with a voice portal on a portal 
server (Fig 3, col. 1 line 26 shows system embodied on a computer which requires 
storage mediums), said method comprising: 

receiving at least one measure of how distinguishable the current grammar is 
from other grammars of a set of active grammars that are active when the current 
grammar is active, the set of active grammars including the current grammar and at 
least one grammar from a second menu of the voice portal, the at least one measure 
based at least in part on analysis of the test pattern with respect to the set of active 
grammars (steps 340-360, acoustic analysis is performed to compare between different 
sub-vocabularies or menu options [active vocabularies in the instant application] to 
determine acoustic similarities. Column 12 lines 25-64) the at least one measure 
comprising at least least one measure of how distinguishable the current grammar is 
from the at least one grammar from the second menu of the voice portal (The same 
words may appear on several sub menus; Col. 13 line 48-50. Thus when Yuschik 
compares grammars of the same menus to check for acoustic confusability, Yuschik is 
comparing words across menus as well, when a word appears on the menu being 
examined and another menu as well.); and 

determining whether to modify the current grammar based at least in part on the 
at least one measure (system may choose to substitute alternative words; column 12 
line 50). 

Yuschik does not specifically teach: 
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generating for a current grammar of the voice portal representing a valid input for 
a first menu of the voice portal, a test input, the test input for the current grammar 
including a test pattern; 

providing the test input to the voice portal on the portal server using a voice 

server. 

In the same field of predicting word errors, Mahajan teaches generating for a 
current grammar of the system put, the test input for the current grammar including a 
test pattern (At step 202, a portion of training data 304 is spoken by a person 308 to 
generate a test signal, in order to test the recognition models; Column 5 line 11.); 

providing the test input to the voice system on the portal server using a voice 
server (The acoustic signal is converted into waveforms by receiver 309 and feature 
extractor 310, and the feature vectors are provided to a decoder 312; column 5 lines 13- 
15.). 

Therefore it would have been obvious to one of ordinary skill in the art to 
substitute actual acoustical data as taught by Mahajan for the phonetic representations 
in Yuschik in order to facilitate a more accurate measure of confusion between sub- 
vocabularies. 

1 7. Claim 9 is directed towards a computer readable storage medium designed to 
execute a method similar to the method of claim 3 and is therefore rejected for similar 
reasons. 
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1 8. Claim 1 0 is directed towards a computer readable storage medium designed to 
execute a method similar to the method of claim 4 and is therefore rejected for similar 
reasons. 

19. Claims 2 and 8 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Yuschik in view of Mahajan as applied to claims 1 and 7 above, and further in view of 
Shao et al (2002/0049593). 

20. Consider claim 2, Yuschik and Mahajan teach the method of claim 1 , but does 
not specifically teach wherein deriving a measure of how distinguishable the current 
grammar is from other grammars of the set of active grammars includes deriving a 
confidence level and a set of n-best results for the test input, and wherein the method 
further comprises comparing the confidence level and set of n-best results for the test 
input with an expected value to assess the measure of how distinguishable the current 
grammar is from other grammars of the set of active grammars. 

IN the same field of speech ambiguity measurement, Shao teaches wherein 
deriving a measure of how distinguishable the current grammar is from other grammars 
of the set of active grammars includes deriving a confidence level and a set of n-best 
results for the test input (paragraph 0046, best match in compared with 2 nd best, which 
is n-best, where n=2), and wherein the method further comprises comparing the 
confidence level and set of n-best results for the test input with an expected value to 
assess the measure of how distinguishable the current grammar is from other 
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grammars of the set of active grammars (paragraph 0046, best match score and 
ambiguity ratio). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the art to use an ambiguity ratio as taught by Shao in the system of Yuschik and 
Mahajan in order to more accurately determine the similarities between two sub- 
vocabularies (Shao 0014). 

21 . Claim 8 is directed towards a computer readable storage medium designed to 
execute a method similar to the method of claim 2 and is therefore rejected for similar 
reasons. 

22. Claims 5, 6, 1 1 -1 3, 1 5, and 1 6 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Yuschik in view of Mahajan as applied to claims 1 and 7 above and 
further in view of Randic (US Patent 6,275,797). 

23. Consider claim 5, Yuschik and Mahajan teach the method of claim 1 , but does 
not specifically teach modifying the test pattern to emulate one or more user voices prior 
to entering the test input into the voice portal. 

In the same field of speech testing, Randic suggests modifying the test pattern to 
emulate one or more user voices prior to providing the test input to the voice portal 
(Figure 1 shows using a voice test file generated by a TTS engine used to test the voice 
path using recognition. This is a similar technique used to test the quality of recognition 
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in Mahajan. Using a computer generated voice to generate the test file, Column 3 line 
27, would inherently allow the test pattern to emulate whatever voice the computer 
generation system was configured to produce. Further, it is well known in the art that 
TTS engines can be configured to allow for the generation of multiple voice types, 
although the claim language suggest that just one voice could be used.). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to use the computerized speech generation as taught by Randic in 
place of the human speaker as taught by Yuschik and Mahajan in order to allow the 
speech recognizer to become more flexible through the quality analysis. 

24. Consider claim 6, Yuschik and Mahajan teach the method of claim 1 , but does 
not specifically teach modifying the test pattern to emulate the influence of one or more 
communications network qualities prior to providingthe test input into the voice portal. 

In the same field of speech testing, Randic teaches modifying the test pattern to 
emulate the influence of one or more communications network qualities prior to entering 
the test input into the voice portal (figure 3 shows passing the voiced speech pattern 
through a transmission scheme in order to evaluate the effect that the voice channel 
has on recognition; column 4, line 31 - column 7 line 29.). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to combine the analysis of the voice channel as taught by Randic with 
the speech recognition quality evaluation of Yuschik and Mahajan in order to make the 
speech recognizer more robust. 
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25. Claim 1 1 is directed towards a computer readable storage medium designed to 
execute a method similar to the method of claim 5 and is therefore rejected for similar 
reasons. 

26. Claim 12 is directed towards a computer readable storage medium designed to 
execute a method similar to the method of claim 6 and is therefore rejected for similar 
reasons. 

27. Consider claim 1 3, Yuschik teaches A system for evaluating grammars of a voice 
portal executing on a portal server, the system comprising: 

an analysis interface for extracting a current grammar from a set of active 
grammars of the voice portal, the current grammar representing a valid input for a first 
menu of the voice portal and being one grammar of the set of active grammars, the set 
of active grammars including at least one grammar from a second menu of the voice 
portal (steps 340-360, acoustic analysis is performed to compare between different sub- 
vocabularies or menu options [active vocabularies in the instant application] to 
determine acoustic similarities. Column 12 lines 25-64)); 

a results collector for analyzing the test input entered into the voice portal against 
the set of active grammars (steps 340-360, acoustic analysis is performed to compare 
between different sub-vocabularies or menu options [active vocabularies in the instant 
application] to determine acoustic similarities. Column 12 lines 25-64) ; and 
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a results analyzer for deriving a set of statistics indicative of how distinguishable 
the current grammar is from other grammars of the set of active grammars (system may 
choose to substitute alternative words if not distinguishable; column 12 line 50) the at 
least one measure comprising at least least one measure of how distinguishable the 
current grammar is from the at least one grammar from the second menu of the voice 
portal (The same words may appear on several sub menus; Col. 13 line 48-50. Thus 
when Yuschik compares grammars of the same menus to check for acoustic 
confusability, Yuschik is comparing words across menus as well, when a word appears 
on the menu being examined and another menu as well.). 

Yuschik does not specifically teach: 

a test pattern generator for generating a test input for the current grammar, the 
test input including a test pattern; 

In the same field of predicting word errors, Mahajan teaches a test pattern 
generator for generating a test input for the current grammar, the test input including a 
test pattern (At step 202, a portion of training data 304 is spoken by a person 308 to 
generate a test signal, in order to test the recognition models; Column 5 line 11.); 

Therefore it would have been obvious to one of ordinary skill in the art to 
substitute actual acoustical data as taught by Mahajan for the phonetic representations 
in Yuschik in order to facilitate a more accurate measure of confusion between sub- 
vocabularies. 

But Yuschik and Mahajan do not teach specifically using a text to speech engine 
to enter data into the voice porthole. 
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In the same field of speech signal testing, Randic teaches using a text to speech 
engine to generate test signals for a system (Figure 1 shows using a voice test file 
generated by a TTS engine used to test the voice path using recognition. This is a 
similar technique used to test the quality of recognition in Mahajan. Using a computer 
generated voice to generate the test file, Column 3 line 27, would inherently allow the 
test pattern to emulate whatever voice the computer generation system was configured 
to produce.). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to use the computerized speech generation as taught by Randic in 
place of the human speaker as taught by Yuschik and Mahajan in order to allow for 
more efficient and more comprehensive quality analysis of the recognizer 

28. Consider claim 1 5, Mahajan and Yuschik in view of Randic teaches the system of 
claim 13, but does not specifically teach modifying the test pattern to emulate one or 
more user voices prior to entering the test input into the voice portal. 

However Randic teaches modifying the test pattern to emulate one or more user 
voices prior to entering the test input into the voice portal (Figure 1 shows using a voice 
test file generated by a TTS engine used to test the voice path using recognition. This 
is a similar technique used to test the quality of recognition in Mahajan. Using a 
computer generated voice to generate the test file, Column 3 line 27, would inherently 
allow the test pattern to emulate whatever voice the computer generation system was 
configured to produce. Further, it is well known in the art that TTS engines can be 
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configured to allow for the generation of multiple voice types, although the claim 
language suggest that just one voice could be used.). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to use the computerized speech generation as taught by Randic to 
emulate a user voice in order to allow for more efficient and more accurate quality 
analysis of the recognizer. 



29. Consider claim 1 6, Mahajan teaches the system of claim 1 3, wherein the test 
pattern generator is modified to emulate the influence of one or more communications 
network qualities prior to entering the test input into the voice portal, (figure 3 shows 
passing the voiced speech pattern through a transmission scheme in order to evaluate 
the effect that the voice channel has on recognition; column 4, line 31 - column 7 line 
29.). 



30. Claims 14 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Yuschik in view of Mahajan in view of Randic as applied to claim 13 above, and further 
in view of Shao et al (2002/0049593). 



31 . Consider claim 1 4, Yuschik and Mahajan and Randic teach the system of claim 
13, but does not specifically teach wherein deriving a measure of how distinguishable 
the current grammar is from other grammars of the set of active grammars includes 
deriving a confidence level and a set of n-best results for the test input, and wherein the 
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method further comprises comparing the confidence level and set of n-best results for 
the test input with an expected value to assess the measure of how distinguishable the 
current grammar is from other grammars of the set of active grammars. 

In the same field of speech ambiguity measurement, Shao teaches wherein 
deriving a measure of how distinguishable the current grammar is from other grammars 
of the set of active grammars includes deriving a confidence level and a set of n-best 
results for the test input (paragraph 0046, best match in compared with 2 nd best, which 
is n-best, where n=2), and wherein the method further comprises comparing the 
confidence level and set of n-best results for the test input with an expected value to 
assess the measure of how distinguishable the current grammar is from other 
grammars of the set of active grammars (paragraph 0046, best match score and 
ambiguity ratio). 

Therefore it would have been obvious to one of ordinary skill in the art at the time of the 
art to use an ambiguity ratio as taught by Shao in the system of Yuschik and Mahajan 
and Randic in order to more accurately determine the similarities between two sub- 
vocabularies (Shao 0014). 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to DOUGLAS C. GODBOLD whose telephone number is 
(571)270-1451 . The examiner can normally be reached on Monday-Thursday 7:00am- 
4:30pm Friday 7:00am-3:30pm. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on (571) 272-7602. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/Douglas C Godbold/ 
Examiner, Art Unit 2626 



